oo 
o 

An Exploratory Study in Maximizing Retention by 
^ Utilizing Black/White and Color Coding in Visualized Instruction 

LlJ 



Richard J. Lamberskl 
Senior Production Specialist 
University Division of Instructional Services 
The Pennsylvania State University 
University Park, Pennsylvania 



us OE^ARTMENT OF HEALTH. 
EOUCATlON A WELFARE 
NATIONAL INSTITUTE OF 
EObCATlON 

THIS DOCUVENT MAS BEEN PE'RO 
DUCEO EXACTLY AS RECEIVED FPOW 
THE PERSON OR ORGANIZATION OR &IN 
ATING IT POINTS 0»^ VIEW OR OPINIONS 
STATED DO NOT NECESSARILY Rf »Rc 
SENT OFFICIAL NATIONAL »NSTlTU'EC»= 
EDUTATiOn POSITION OR POl'CV 



Research and Theory Division 
Association fcr Educational Connunlcations and Technology 
|y> I^ational Convention * Dal' as, Texas 

* April 16, 1975 

6^ 




z 



oo 

O 

An Exploratory Study in Maximizing Retention by 
^ Utilizing Black/White and Color Coding in Visualized Instruction 

LlJ 



Richard J. Lamberski 
Senior Production Specialist 
University Division of Instructional Services 
The Pennsylvania State University 
University Park, Pennsylvania 



us OE^AHTMENT OF HEALTH 
EOUCaTiON & WELFARE 
NATIONAL INSTITUTE OF 
EObCATION 

THIS docuvent mas been RE^BO 

DbCEO EXACTLY AS RECEtVED PROW 
THE PEMSON OR ORGANIZATION OR GtN 
ATlNGlT POINTS 0»^ VIEW OR OPJN'ONS 
STATED DO NOT NECESSARILY RF »Rc* 
SENT OrnCIAL NATIONAL tNSTlTU'EOP 
EDUCATION POSITION 0» POIiCY 



Research and Theory Division 
Association fcr Educational Connaini cat ions and Technology 
l4acional Convention • Dal as, Texas 
* April 16, 1975 

0^ 




An Exploratory Study in Maximising Retention by 
Utilising BlackAfnite and Color Coding in Visualised Instruction 



Background 

Teachers currently are confronted with the problea of selecting and 
organising effective visualised materials to complement regular classroom 
instruction. Inherent in this problem is a need for critical assessment of 
the available visualised materials. I^ford (1969:371) verbalised the 
problem in th3 following manner: 



In viev of the widespread use of currently available 
materials it would be educationally desirable to 
have materials tested and improved as much as 
possible. To do this requires a complete knowledge 
of what elements contribute to effective instruc* 
tional materials* 

Miel (1967) has found that all 8<:udents do not go throu^ the same learning 

sequences in arriving at a similar point in learning; consequent ly^ mere coverage 

of a topic is no guarantee that any particular achievement level will be obtained* 

There seems to exist a se** of undefined rules for interpreting even the simplest 

information (Travers, 1970). Coding may be this set of rules the sCuden needs 

to acquire in order to achieve optimal acquisition of visualised instruction and 

subsequent recall in the evaluation of visualised instruction. In summary of 

the basic problem, Dwyer (1972:7, 8) offers the following stateoient after an 

extensive survey of the literature on color, used as a coding cue in visuals; 

Although color is an important variable in the design 
and cost of instructional materials, the research 
concerning its effectiveness in increasing student 
learning is at best inconclusive • • . • There is 
very little experimental evidence available as to 
how the addition of color to various types of visual 
illustrations will affect student achievement . . * * 
It appears that guidelines for the use of color should 
be established as quickly as possible. 
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Stateaent of the Proble n 

Ihe purpose of this exploratory study vas: (a) to aeasura tt^ relative effec* 
tiveness of two types of cueing (color and black/vhite) found in alaple line 
drawings on imediate and delayed retention tests » (b) to determine vhether the 
two different types of cueing are equally effective in facilitating student 
achievenent on different educational tasks, (c) to deteimine whether student 
achievenent is effected by altering a conditioned visual cueing pattern for 
different educational tasks, (d) to detemine the relative retentional value of 
two types of cueing. 
Instructional Materials and Procedure 

Throughout the investigation considerable effort was taken to inaure that 
the visualised materials %iere identical in tena of contioit for all treataeats» 
the only difference being the technique of cueing: color or black/vhite. Ihe 
preparation and design of materials entailed two complete aeta of audio and viaual 
materials for presentation and evaluation. Each will be discussed separately. 

Preparation of the Presentation Materials. 

The instructional presentation was developed by the investigator and validated 
for content by personnel from The University Division of Instructional Servicea. 
The instructional script vas on the Panasonic, Model 8100, Video Taoe Recording 
System. Recording of the script on audiotape cassette was done by a profesaiooal 
narrator. In addition to the oral dialogue heard by the students via audiotape 
cassette, a topical outline of the content material was prepared and projected 
simultaneously with its appropriate visual illustration. The purpose of the 
projected visual illustration and toplc«»I ot*tline was to allow for individual 
learning preferences during the instructional presentation. Both viaual illustration 
and topical outline were identically cued either color or black/wbltet depending 
upon which treatment the illustrations were intended for. 



A synchroolsing pulse was placed on each audiotaped cassette pexmlttlog the 
narration and corresponding visual illustration and topical outline to be 
sinultaneousiy heard and viewed via tape recorder and carousel slide projectors. 
The visual illustrations consisted of £iaq>le line drawings depicting various 
components to the video recorder systen. The drawings were prepared by a professional 
artist. 

A set of various colored diazo overlays and corresponding set of black 
diazo overlays, illustrating the specific location and spelling of each 
instructional part, were also prepared. Care was taken to assure the correct 
spelling of the words, consistency in size and lettering style, and location of 
labeling words for each set of visuai materials, tephasis on location of each 
part was indicated by means of a straight line between the printed word and the part 
being illustrated. Isolation of each part from the remainder of the visual was 
indicated by means of shading out, with colored or blackened diazo, the location 
:f each instructional part. Slides were then taken of each instructional part 
using the same base line drawing, altering the cueing diazo overlays: color or 
black/white. 

The completed presentation material consisted ot two sets of instructional 
materials consisting of an audiotape cassette and 88 pairs of 2 x 2 slides 
(visual illustration and topical outline), varying only in the cueing variable. 

Preparation of the Evaluation Materials. 

The evaluation materials were written by the investigator and validated by 
personnel from The University Division of Instructional Services. Production of 
the audiotaped cassette, visual illustrations, and slides used in evaluation were 
produced in exactly the same method as the instructional presentation materials. 



Hm coapl^t^d evmluatioa aaterlAl consisted of two sets of Mterlals consisting of 
sn niidiot«pr4 cssfctts %Ath nsrrstivs test directions end 30 psirs of 2 z 2 
slides, veryiof only in the technique of cueing. The eveluetion slides consisted 
of the five dependent vsrisbles, the criterion sessures. 
Criterion Mcssures 

The criterion aessures consisted of tasks aeesuring lov cognitive skills. 
Ibe four criterion seesures: associetion tesk, terminology task, drewing task 
and knowledge task were si—nl to yield a fifth dependent variable, a total 
criterial task score. The total cri^erial task demonstrated the total understanding 
of the concepts presented (Kuder-Eidiardson Ponmla 20 Reliability • .89). 

Ibe set of association task slides consisted of 15 visual illustrations. 
Ibe task slides were the id^tical slides which were used in the instructional 
prestttation; the only difference was that the labeling word identifying die 
instructional part was removed. The student was asked to write die correct word 
for each visual next to the corresponding number on die answer sheet. Ibe task 
requires the student to associate the visual with a specific fact of knowledge, 
the proper label. 

The set of terminology task slides consisted of 15 visual illustratiooa 
depicting incomplete sentences. The slides were cued in the same manner as the 
topical outline slides in the instructional presentation. The task requires the 
student to demonstrate knowledge with a large nimdier of words in their nmniii 
range of meanings. 

The drawing test slides consisted of two slides with 16 labels of parts. 
The student was asked to draw a simple line drawing of the video tape recorder 
console, locating and labeling the parts with the proper term. The student was 
also asked to trace the route of a threaded video tape. The task requires the 
recall of specific and isolated bits of information. 

-4- 




The set of knowledge task slides consisted of 10 oultlple choice questions 
and 5 true or false questions. The slides were cued In the same nanner as the 
topical outline slides it. the Instructional presentation. The task requires the 
student to recall specifics and universals regarding the processes Involved In 
the use of a video tape recording system. 
Treataents 

The Battle population for this Investigation consisted of 152 8t«tdents who 
%rere enrolled in Instructional Media 411 at The Pennsylvania State University. 
Students were randomly assigned to treatiaent conditions for both the inaedlate 
analysis and the delayed analysis. 

The randon assignaent of students to treatments aay be best represented in 
Table 1. The investigation contained two treatments (1 & 2) at the iaoiediate 
analysis acd four treataents (A, B, C & D) at the delayed analysis. 

Table 1. Suoaary of Subjects by Treatments and Analysis 



Instructionol 
PrateMotion 



Immediote Analytis 



Delayed Anolytit 




Color Pres. 



n«67 



Color Pres./ 
Color Evol. (I) 
n«67 




Color Pres./ 
. ;^Color Evol. (A) 
n«40 



Subjectt 
n-152 



^Color Pres./ 
BkaWEvoKS) 
n«27 



Bk aw Pres. 



n«85 



Bk a W Pres./ 
3 : a W Evol. (2) 
n«85 




Bk a W Pres./ 

Color Evol. (C) 
n>4l 



Bk a W Pres./ 
Bk a W EvaKD) 
n«44 
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rreataenc (A). Students in treatment (A) received audioteped Instruction 
coaplcifiented by color cued visuals and a color cued ionediate retention test. For 
ianediate analysis, treatment (A) was a subset of treataent (1). Students in 
treatBcnt (A) received a color cued delayed retention test two %ieeks after the 
instructional presentation. 

Treataent (B). Students in treatoient (B) received audiotaped instruction 
coBplcaented by color cued visuals and a color cued iaBiedlate retention test. For 
innediate analysis, treatnent (B) was a subset of treatMnt (1). Students in 
treataent (B> received a black/white cued delayed retention test tvo ve^^ after 
the instructional presentation. 

Treatamit (C). Students in treataent (C) received audiotaped instruction 
coopleaented by black/vhite cued visuals and a black/uhite cued laoiediate 
retention test. For iaaedlate analysis, treatnent (C) was a subset of treatment 
(2). Students In treataent (C) received a color cued delayed retention test two 
weeks after the instructional presentation. 

Treatment D). Students in treatment (D) received audiotaped instruction 
complemented by black/i4iite cued visuals and a black/vhita cued ionediate 
retention test. For iaaediate analysis, treatment (D) was a subset of treatment 
(2). Students in treatment (D) received a black/vhlte cued delayed retention test 
two weeks after the instructional presentation. 
Design 

For all treatnent groups, the content of rhe instructional presentation and 
imaedlate and delayed retention tests was identical. The only independent 
variable in the instructional presentation and the retention tests was the 
technique of cueing used in the visual illustrations. The dependent variables 
consisted of five criterion measures evaluating student achievement on different 
educational tasks. 
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All statistical tests were conducted at .05 level for alpha. Upon completion 
of the instructional presentation subjects in treatments (1) and (2) vere 
administered an immediate retention test, also containing the independent variable 
of cueing. Analysis of the immediate retention test was conducted via Behrens* 
Fisher t-tests for the five dependent criterion measures. 

Two weeks after the Immediate retention test, subjects were randomly assigned 
to four new treatments (A), (B), (C), and (D). A delayed retention test identical 
in content to the immediate retention test was administered to subjects in 
treatments (A) and (D). Treatments (B) and (C) received a delayed retention test 
opposite in cueing technique '-hen received on the iaaiediate retention test. 
Analysis of the delayed retention test %fas conducted via one-^ay analysis of 
variance on each of the five criterion aieasures. Multiple comparisons between* 
treatment means were analyzed via TUkey's WSD- Procedure. 

A retention analysis, which is computed by subtracting the delayed test 
scores from the inmediate test scores, was conducted in the sane manner as the 
delayed analysis. 
Findings 

Imediate Analysis. Multiple Behrens*?isher t-tests on the five criterion 
measures indicated that significant differences existed on the terminology task 
(t • 1,983, df » 115, p.< .05), knowledge task (t • -4.238, df • 135, p. < .01), 
and the total criterial task (t > -2.396, df » 117, p.< .05). Ibus in three out 
of five iiimiediate criterion measur^^s, the black/white cueing technique was more 
effective for facilitating studen': achievement (see Figure 1; Tables 2 and 3). 

Delayed Analysis. An analysis of variance conducted on the scores achieved on 
the evaluative measures indicated that no significant differences existed on the 
five criterioa measures (see Figure 2, Tables 4 and 5). Bartlett*s Test for 
homogeniety of variances was conducted on all analysis of variance tests; all tests 
for homogeniety yielded insignificant chi-square distributions at the .05 level 
of alpha. 
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Figure 1. Plot of the Treatnent Means for the Different Educational 
Tasks for the Inmediate Retention Analysis 
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Table 2, Treataent Sunamry Table for the lomediate Retention Analysis 



Instructional Treatments 



(1) (2) 
Color Presentation/ Bk. h W. Presentation/ 

Color Evaluation Bk, & W, Evaluation 



CRITERION X «" 67 






83 


MEASUilES X 


MEAN 


S.D. 


MEAN 


S.D. 


AsaoclAtion 










Task 


42.59 


25.30 


44.48 


18.78 


Teminology 










Task 


39.80 


22.26 


6.20 


15.97 


Drawing 










Tartc 


42.05 


22.68 


48.79 


18.91 


Knovladge 










Task 


63.98 


15. S3 


74.43 


14.10 


Total Crlterlal 










Task 


46.94 


18.31 


53.32 


13.33 



Table 3. Suonary of the Statistical Analyses on the Differ^t Educational Tasks 
for the Imedlate Retention Analysis 



CRITERICm \ 






Results of Treatment 


MEASURES \ 


d£ 


t-Value 


Mean Coaq>arisoa8 


Association 








Task 


118 


-0.510 


Color (l)«Black and White (2) 


Texmlnology 








Task 


115 


-1.933* 


Black and White (2)>Color (1) 


Drawing 








Task 


128 


-1.955 


Color (l)«Black and White (2) 


Knowledge 






Task 


133 


-4.238** 


Black and White (2)Xolor (1) 


Total Criterial 








Task 


117 


-2.396* 


Black and White (2)Xolor (1) 
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Figure 2. Plot of the Treatment Means for the Different Educational 
Tasks for the Delayed Reteati n Analysis 
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Table 4, Treatanent Sumnary Table for the Delayed Retention Analysis 



Instructional Treatment?t 



CRITERION 
MEASURES 



(A) 

Color Pres./ 
Color Eval. 
n= 40 



MEAN 



S.D. 



(C) 

Colo- Bk. & W. Pres./ 

Bk. & W. ^/al. Color Ev.:l. 

27 41 

MEAN S.D. MEAN S.D. 



Bk. & W. Pres./ 
Bk. & W. Eval. 



44 



MEAN 



Association 


















Task 

Terminology 


33.16 


18.46 


32.10 


15.42 


35.13 


13.91 


37.27 


16.98 


Task 
Drawing 


38.33 


20.57 


35.06 


20.22 


39.51 


15.66 


39.09 


17.40 


Task 

Knowledge 


40.44 


18.23 


37.91 


15.17 


36.01 


16.86 


43.98 


17.0-^ 


Task 

Total Criterial 


56.33 


15 <>9 


59.01 


16.40 


59.84 


14.41 


61.51 


14 . 


Task 


42.02 


14.53 


40.92 


13.45 


42.4i 


12.26 


45.42 


13.36 



Table 5, Sumaary of the Statistical Analyses on the Different Educational Tasks 
for the Delayed Retention Analysis 



CRITERION \ 




Results of Treatment 


MEASURES \ 


F-Ratio (df==3/148) 


Mean Con^>ari6ons 


Association 






Task 


0.702 


A = B = C * D 


Terminology 






Task 


0.778 


A = B = C » D 


Drawing 






Task 


1.696 


A * B = C » D 


Knowledge 






Task 


0.833 


A « B « C » D 


Tr' al Criterial 






Task 


0.790 


A » B = C « D 
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Retention Analysis. An analysis of variance conducted on the informational 
loss scores, derived by subtracting the delayed retention test scores from the 
Ifficiediatc retention test scores, indicated that significant differences existed 
on four of five criterion measures. Significant differences were achieved on 
the terminology task (F - 3.825, df = 3/148, p. < .05), drawing task (F » 3.200, 
df = 3/148, p. <.05), knowledge task (F = 4.443, df « 3/143, p. < .01), and the 
total criterial task (F « 2.841, df - 3/148, p. < .05). Analysis of the differences 
between pairs of treatment means, via Tukey's WSD-Procedure, indicated that on 
the terminology task the line drawing presentation and evaluation with color 
cueing was found to be less receptive to informational loss than the line drawing 
presentation and evaluation with black/white cueing (Treatment (A) < Treatment (D), 
t « 3.20, df * 148, p. < .01). Also the color cued line drawing presentation and 
evaluation was found to reduce informational loss more than the black/white cued 
presentation with color cued evaluation for the drawing task (Treatment (A) < 
Treatment (C), t « 3.05, df « 148, p. <.05). On the knowledge task, the color 
cued presentation wiuh black/white evaluation wa- ignificantly less receiptive 
to informational loss than the black/white cued presentation with color cued 
evaluation (Treatrr-nt (B) < Treatment (C), t » 3.45, df • 148, p. -^.01). Lastly, 
aluhough the F-ratio for the total criterial task was significant, investigation 
of the differences between means revealed no significant multiple comparisons. It 
must be assumec* that the variation causing the significant F-ratio is attributable 
to something other than the main variable - cueing. Visual examination of the 
data reveals a possible presentation X evaluation interaction which needs examination 
in another study (see Figure 3; Table 6), 
Suumarv and Conclusions 

Tlie purpose of this exploratory study was: (a) to measure the relative 
effectiveness of two types of cueing (color and black/white) found in simple line 
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Figure 3. Plot of the Treatment Means for the Different Educational 
Tasks for the Retentional Analysis 
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Table 6. Summary of the Statistical Analyses of the Different Educational Tasks for 
the Retentional Analysis 



I. Association Task > F-Ratio (df=3/148)«0.157 



WSD^* Treatment Comparisons 











(B) (C) (D) 


Treatment 


n 


S.D. 


MEAN 


(9.39) (8.1^j (8.33) 


Color Pres. /Color Eval. (A) 


40 


16.33 


10.17 


0.21 0.60 0.55 


Color Ptes./Bk. & W. Eval. (B) 


27 


15.60 


'9.39 


0.33 0.28 


Bk. & W. Prea. /Color Eval. (C) 


41 


15.39 


8.13 


0.06 


Bk. L W. Pres./Bk. & W. Eval. (D) 


44 


13.73 


8.33 




II. TermlnoloKV Task. F-Ratio fdf=3/14a'i=3-85S* 














WSD-Treatment Comparisons 










(B) (C) (D) 


Treatment 


n 


S.D. 


MEAN 


(6.67) (2.93) (10.61) 


A 


40 


13.71 


0.16 


1.75 0.83 3.20** 


B 


27 


13.07 


6.67 


1.00 1.08 


C 


41 


15.49 


2.93 


2.36 


D 


44 


16.55 


10.61 




III. Drawing Task. F-Ratio f<?f«3/148^«3.200* 
















WSD^Treatment Comparisons 










(B) (C) (D) 


Treatment 


n 


S.D. 


MEAN 


(4.57) (11.05) (6.41) 


A 


40 


14.25 


1.32 


0.91 3.05* 1.62 


B 


27 


14.35 


4.57 


1.82 0.53 


C 


41 


14.95 


11.05 


1.49 


D 


44 


13.94 


6.41 




IV, Knowledge Task. F-Ratio Td £=3/148 ^=4. 443** 














WSD-Treatment Comparisons 










(B) (C) (D) 


Treatment 


n 


S.D. 


MEAN 


(3.45) (15.28) (12.27) 


A 


40 


13.09 


8.66 


1.51 2.15 1.19 


B 


27 


15.28 


3.45 


3.45** 2,61 


C 


41 


12.94 


15«28 


1.00 


0 


44 


14.38 


12.27 




V. Total Criterial Task. F-Ratic 


(df=3/148) 


=2.841* 














WSD-Treatment Comparisons 










(B) (C) (D) 


Treatment 


n 


S.D. 


MEAN 


(5.97) (9.40) (9.31) 


A 


40 


9.24 


4.96 


0.48 2.36 2.35 


B 


27 


8.72 


5.97 


1.63 1.61 


C 


41 


7.96 


9.40 


0.05 


D 


44 


8.07 


9.31 




*p<.05 'f*p<,01 
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drawings on immediate and delayed retention tests » (b) to determine irfiether the 
two different types of cueing are equally effective in facilitating student 
achievement on different educational tasks, (c) to detemine whether student 
achievement is effected by altering a conditioned visual cueing pattern for 
different educational tasks , (d) to determine the relative retentional value of 
two types of cueing. 

Two sets of presentation and evaluation audio*slide materials were developed to 
be the same in narrative and visual content, yet varying on the independent visual 
variable of cueing technique: color or black/white. Inherent to the presentation 
materials were simple line drawings developed to complement the audlotaped 
instruction; while five evaluative measures were developed to assess student 
achievement of different low cognitive skills presented in the instruction. Key to 
the procedure was the utilization of the same visual cueing technique in the 
presentation and evaluation materials. 

Gne hundred and fifty*two college students were randomly assigned to treatment 
conditions. Each student interacted with the instructional presentation and 
completed an immediate and two week delayed test on the five evaluative measures. 
The results of this study suggest a number of conclusions to be taken into consideration 
in the preparation of simple line drawings to complement verbal instruction. 

(1) Results Indicated that the amount of student achievement attributable 
to differing cueing technique (color & black/white) varies significantly in 
iomedlate testing for different educational tasks. Analysis generally favored the 
black/white treatment condition. 

(2) There appears to be no significant achievement difference attributable 
to cueing technique at a two week delayed test analysis for different educational 
tasks. 

-15- 
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(3) Mean creatment scores reflected a trend that by altering a conditioned 
cueing technique in delayed evaluative testing, the loss of student achievement 
is appreciable for different educational tasks (see Figure 4)« 

(4) A significant mean difference was found among treatment conditions in 
analysis of the retentional value of cueing technique. Significance was 
interpreted as having originated due to different post instruction achievement, as 
reflected by immediate test analysis, rather than attributable directly to a 
particular cueing technique. 

Discussion 

The data collected in this study appears to support the contention that the 
mere addition of color in visualized instruction does not mean an efficient 
increase in student achievement. There appears to «>e other related factors. 

The effectiveness of the black/white treatment in Imnediate analysis can be 
attributable to the pacing and the narration during presentation. Ihe external pace 
of the audioes lide presentation and evaluation did not permit review, reinforcement, 
or recall of the desired paired response. Thus there appears to have been 
insufficient time for a significant conditioned association between color code 
and concept to develop. Furthermore the combination of pace, color coding, and 
audio narration night have surpassed the known human filtering capacity. Thus, 
the addition of color might have become an irrelevant cue because of pace and 
narrative dominance. 

The data indicate*^^ in both the imnediate analysis and the delayed analysis 
that the effecti/^'^'^ss of visualization to facilitate student achievement decreased 
as the level of cognitive task increased. This might be attributable to 
instrumentation or design rather than attributable to the factor of visualization. 
It is recomnended that the data needs to be substantiated before a concrete 
intrepretation can be made. The data also indicated a definite trend of information 
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Figure 4. Plots of the Treatmeiit Means for ]kmediate and Delayed 
Testing for Different Educational Tasks 
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loss for the altered cueing treatments (B and C); this suggests that a consistency 
between presentation and evaluation modes should be considered once a visual 
code has been conditioned. The resulting no significant differences in the 
delayed analysis, and the resulting mixed significant differences in the 
retention analysis should be interpreted with extreme caution. The results of 
the two analyses appear more attributable to a regression about the mean and 
differing levels of immediate retention rather than attributable to a specific 
coding effect* 

This exploratory study has revealed that different coding techniques do 
elicit varying levels of student achievement for different educational tasks* 
Further studies will investigate the effect upon information loss and retention 
when subjects are conditioned to a specific competency level for a given coding 
technique during presentation of the instructional materials. What also would be 
the instructional effect of coding if the pace were altered from external to 
internal. Lastly chere appears to be a need to separate coding techniques by 
a multifactor design to investigate the relationship and interaction of 
presentation to evaluation (modality consistency), pace (external vs. internal), 
time (immediate retention vs. delayed retention), educational task (objectives), 
and individual learner characteristics. 
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